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« The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)^ Responsive to communication(s) filed on 04 June 2003 . 
2a)D This action is FINAL. 2b)M This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims 

4) 0 Claim(s) 1,3,5.6 and 15-23 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

Q)M Claim(s) 1,3,5,6 and 15-23 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

1 1) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§ 1 1 9 and 1 20 

13) 13 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

bMAW b)D Some*c)D None of: 

1 Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121 . 

Attachment(s) 

1) 13 Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) Paper No(s). . 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-1 52) 

3) C] Information Disclosure Statement(s) (PTO-1 449) Paper No(s) . 6) {Z\ Other: 

U.S. Patent and Trademark Office "~ 

PTO-326 (Rev. 04-01) Office Action Summary Part of Paper No. 6 
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DETAILED ACTION 
Response to Amendment 

1. Applicant's arguments with respect to claims 1 , 3, and 5-6 have been considered 
but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 (JSC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claim 1, 15, 16, 18, 20, and 22 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Wactlar (5,825,667), and further in view of Kazami et al (6,035,093). 

Regarding claim 1, Wactlar et al disclose an information storage medium for 
recording audio information and still image information recording (Col 16, lines 48-49 
"the use of disk striping on disk arrays"): 

• one or more music reproduction units for reproducing the audio information 
(Col 3, line 4 "audio can be played"); and 

• set information for setting the still image information to represent contents of 
the first reproduction unit (Col 1 1 , lines 66-67 "Each paragraph may be 
reasonably abstracted by a 'representative frame'"), 

• wherein the set information is provided for at least one of the music 
reproduction units(Col 11, lines 66-67 "Each paragraph may be reasonably 
abstracted by a 'representative frame,'"), and 
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• Wactlar suggests the still image information configured to be displayed first in 
the music reproduction unit is set as the still image information being 
representative of the contents of the music reproduction unit (Col 17, lines 52- 
53 "image processing helped select representative still images for icons and 
sequences from scenes"), but does not specifically disclose the automatic 
selection of the first shown image as being the representative image. 

Kazami teaches the use of the first image in a file as being a 
representative image (Col 1 , lines 55-59 "The computer partially reads out the 
leading image from the selected image file, and generates a thumbnail image 
by reducing the pixel density of that leading image. The thumbnail image 
generated in this manner is displayed in a list with its associated file name"). 

As suggested by Wactlar and taught by Kazami, the selection of a first 
image as a representative image of a sequence of images is a well known 
method of providing a user with image information to aid in the selection of an 
image file. Therefore, it would have been obvious to modify Wactlar to select 
the image to be displayed first as a representative image of a file comprising 
a sequence of images. 
Regarding claims 16 and 20, Wactlar discloses a method and apparatus for 
reproducing the audio information and the still information from the medium of claim 1 
(Title, Method and apparatus for creating a searchable digital video library and a 
SYSTEM AND METHOD OF USING SUCH A LIBRARY"). 
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Regarding claim 18, Wactlar discloses a method for recording the management 
information with respect to the still image information of the representative image on the 
medium of claim 1 (Abstract "steps of storing the indexed audio data and the digitized 
video data with their respective sets of time-stamps is also provided"). 

Regarding claim 22, Wactlar discloses an apparatus for recording the audio 
information and the still image information on the medium of claim 1 (Abstract "storing 
the indexed audio data"). 

Regarding claim 15, Wactlar discloses a method for reproducing music 
information from an information storage medium which records audio information 
associated with a representative image (Col 3, line 4 "audio can be played" and Col 1 1 , 
lines 66-67 "Each paragraph may be reasonably abstracted by a 'representative 
frame'"), still image information including the representative image (Col 17, Iine48 
"Appearing on the screen are several icons"), and management information (Abstract "a 
first set of time-stamps"), the reproducing method comprising: 

• reproducing the management information to search for the representative 
image (Col 5, lines 25-27 "The digital video library system provides full- 
content search of, and retrieval from, an on-line database"); and 

• reproducing the audio information corresponding to the searched 
representative image (Col 17, lines 60-62 "The screen fills with a video of 
Arthur Clarke describing how he did not try to patent communications 
satellites"). 
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• Wactlar suggests the still image information configured to be displayed first in 
a unit of music reproduction is being set as the representative image (Col 17, 
lines 52-53 "image processing helped select representative still images for 
icons and sequences from scenes"), but does not specifically disclose the 
automatic selection of the first shown image as being the representative 
image. 

Kazami teaches the use of the first image in a file as being a 
representative image (Col 1 , lines 55-59 "The computer partially reads out the 
leading image from the selected image file, and generates a thumbnail image 
by reducing the pixel density of that leading image. The thumbnail image 
generated in this manner is displayed in a list with its associated file name"). 

As suggested by Wactlar and taught by Kazami, the selection of a first 
image as a representative image of a sequence of images is a well known 
method of providing a user with image information to aid in the selection of an 
image file. Therefore, it would have been obvious to modify Wactlar to select 
the image to be displayed first as a representative image of a file comprising 
a sequence of images. 
4. Claims 3, 17, 19, 21, and 23 are rejected under 35 U.S.C. 103(a) as being 
unpatentable by Maruyama et al (6,453,1 19), and in further view of Kazami et al 
(6,035,093). 

Regarding claim 3, Maruyama et al disclose an information storage medium 
(Col 1, lines 11-12 an information recording medium") for recording audio (Col 33, lines 
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3-4 "Audio objects are contents... of audio data"), still image (Col 33, lines 1-3 "Picture 
objects are still picture information such as still pictures and slide pictures"), and one or 
more reproduction sequences for reproducing the audio information (Col 23, lines 31-33 
"Program chain contents... indicate the number of programs and number of cells... in the 
program chain"), wherein, in at least one of the reproduction sequences, the still image 
information is configured to be displayed at the same time when the audio information is 
reproduced (Col 9, lines 29-38 "Each video title set stores... audio data... and also 
information for playing back these data"), the medium being configured to record: 

• information for specifying or designating the still image information to 
represent contents of the reproduction sequence in which the still image 
information is to be displayed (Col 39, lines 16-17 "representative picture data 
can be used as a material for an icon") 

• Maruyama et al suggest the still image information configured to be displayed 
first in the music reproduction unit is set as the still image information being 
representative of the contents of the music reproduction unit (Col 39, lines 16- 
17 "representative picture data can be used as a material for an icon"), but 
does not specifically disclose the automatic selection of the first shown image 
as being the representative image. 

Kazami teaches the use of the first image in a file as being a 
representative image (Col 1, lines 55-59 "The computer partially reads out the 
leading image from the selected image file, and generates a thumbnail image 
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by reducing the pixel density of that leading image. The thumbnail image 
generated in this manner is displayed in a list with its associated file name"). 

As suggested by Maruyama and taught by Kazami, the selection of a 
first image as a representative image of a sequence of images is a well 
known method of providing a user with image information to aid in the 
selection of an image file. Therefore, it would have been obvious to modify 
Maruyama to select the image to be displayed first as a representative image 
of a file comprising a sequence of images. 
Regarding claims 17 and 21, Maruyama et al disclose a method for reproducing 
the audio information and the still image information from the medium of claim 3 (Col 1 , 
lines 19-20 "an information playback method" and Col 33, lines 3-4 "Audio objects are 
contents... of audio data" and Col 33, lines 1-3 "Picture objects are still picture 
information such as still pictures and slide pictures"). 

Regarding claims 19, Maruyama et al disclose a method for recording the 
management information with respect to the still image information of the representative 
image on the medium of claim 3 (Col 1, lines 15-16 "an information recording method" 
and Col 23, lines 31-33 "Program chain contents... indicate the number of programs and 
number of cells... in the program chain" and Col 33, lines 1-3 "Picture objects are still 
picture information such as still pictures and slide pictures"). 

Regarding claim 23, Maruyama et al disclose an apparatus for recording the 
audio information and the still image information on the medium of claim 3 (Col 26, lines 
27-28 "The disc drive unit that writes/reads [records/ plays back] information to/from 
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DVD disc" and Col 33, lines 3-4 "Audio objects are contents... of audio data" and Col 33, 
lines 1-3 "Picture objects are still picture information such as still pictures and slide 
pictures"). 

5. Claims 5 and 6 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Maruyama et al in further view of Kim et al (6,519,415). 

Regarding claim 5, Maruyama et al disclose a method for setting a 
representative image, wherein the setting method uses an information storage medium 
for recording audio information, still image information, and management information 
indicative of a reproduction relationship between the audio information and the still 
image information (Col 39, lines 16-17 "representative picture data can be used as a 
material for an icon"), comprising: 

• providing one or more music reproduction units for reproducing the audio 
information which includes first audio information managed in the music 
reproduction unit (Col 33, lines 3-4 "Audio objects are contents... of audio 
data"); 

• recording, in the management information, a still image being coincident with 
the representative image of contents of the first audio information before 
being divided, as a representative image of contents of the second audio 
information and as a representative image of contents of the third audio 
information (Col 39, lines 16-17 "representative picture data can be used as a 
material for an icon"). 
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• Although Maruyama suggests dividing the first audio information managed in 
the music reproduction unit into second audio information and third audio 
information (Col 2, lines 53-60 "a first area for storing... a plurality of 
pictures... and a third area... for specifying a storage position of representative 
picture data"), they do not specifically disclose the display of multiple pictures 
during a single audio playback event. 

Kim et al teach of the use of a plurality of pictures being displayed with 
the playing of an audio recording (Col 2, lines 26-29 "the method linked to the 
still pictures on a rewritable storage media includes recording obtained still 
pictures and/or audio signals which will be reproduced together with 
correspondent still pictures"). 

As suggested by Maruyama and taught by Kim, being able to play 
several still pictures in a single audio sequence would provide for a clean, 
continuous presentation that would not require user intervention to advance 
from one picture to the next. Therefore, it would have been obvious to one of 
ordinary skill in the art at the time of the invention to divide the audio 
information into a sequence of informations, each information associated with 
an individual still picture. 

• Maruyama discloses a method for setting a representative image, wherein the 
second and third audio information can be used to reproduce music 
corresponding to the first audio information (Col 34, lines 57-61 "Program set 
1402 consists of a set of a plurality of original cells=VOBs (video objects) 
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1403, 1404, and 1405 divided in accordance with the contents of audio & 
video data and the order of information recorded in AV file 1401"). 
Regarding claim 6, Maruyama et al disclose a method for setting a 
representative image, wherein the setting method uses an information storage medium 
for recording audio information, still image information, and management information 
indicative of a reproduction relationship between the audio information and the still 
image information (Col 39, lines 16-17 "representative picture data can be used as a 
material for an icon"). 

• Although Maruyama et al suggest providing one or more music reproduction 
units for reproducing the audio information which includes fourth audio 
information and fifth audio information managed in the one or more music 
reproduction units; 

• combining the fourth audio information and the fifth audio information to form 
sixth audio information reproduced in the first reproduction unit; and 

• recording in the management information, the representative image of 
contents of earlier-reproduced audio information, as a representative image of 
contents of the sixth audio information, wherein the earlier-reproduced audio 
information indicates one of the fourth audio information before combining 
and the fifth audio information before combining, which one is reproduced 
earlier than the other after being combined, and 

• wherein the sixth audio information can be used to reproduce music 
corresponding to the fourth and fifth audio information (Col 2, lines 53-60 "a 
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first area for storing... a plurality of pictures... and a third area. ..for specifying 
a storage position of representative picture data"), they do not specifically 
disclose the display of multiple pictures during a single audio playback event. 

Kim et ai teach of the use of a plurality of pictures being displayed with 
the playing of an audio recording (Col 2, lines 26-29 "the method linked to the 
still pictures on a rewritable storage media includes recording obtained still 
pictures and/or audio signals which will be reproduced together with 
correspondent still pictures"). 

As suggested by Maruyama and taught by Kim, being able to play 
several still pictures in a single audio sequence would provide for a clean, 
continuous presentation that would not require user intervention to advance 
from one picture to the next. Therefore, it would have been obvious to one of 
ordinary skill in the art at the time of the invention to divide the audio 
information into a sequence of informations, each associated with an 
individual still picture. 
• Maruyama discloses a method for setting a representative image, wherein the 
fourth and fifth audio information can be used to reproduce music 
corresponding to the first audio information (Col 34, lines 57-61 "Program set 
1402 consists of a set of a plurality of original cells=VOBs (video objects) 
1403, 1404, and 1405 divided in accordance with the contents of audio & 
video data and the order of information recorded in AV file 1401"). 
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6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to James A. Fletcher whose telephone number is (703) 
305-3464. The examiner can normally be reached on 7:45AM - 5:45PM M-Th, first 
Fridays off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Andrew Christensen can be reached at (703) 308-9644. 
Any response to this action should be mailed to: 



Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal 
Drive, Arlington, VA Sixth Floor (Receptionist). 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the Technology Center 2600 Customer Service Office 
whose telephone number is (703) 306-0377. 



Commissioner of Patents and Trademarks 



Washington, DC 20231 



or faxed to: 



(703) 872-9314 (for Technology Center 2600 only). 



JAF 

July 27, 2003 



